Examples of Convergence and Non-convergence of Markov Chains Conditioned Not to Die
نویسندگان
چکیده
In this paper we give two examples of evanescent Markov chains which exhibit unusual behaviour on conditioning to survive for large times. In the first example we show that the conditioned processes converge vaguely in the discrete topology to a limit with a finite lifetime, but converge weakly in the Martin topology to a non-Markovian limit. In the second example, although the family of conditioned laws are tight in the Martin topology, they possess multiple limit points so that weak convergence fails altogether.
منابع مشابه
Rates of Convergence of Some Multivariate Markov Chains with Polynomial Eigenfunctions
We provide a sharp non-asymptotic analysis of the rates of convergence for some standard multivariate Markov chains using spectral techniques. All chains under consideration have multivariate orthogonal polynomial as eigenfunctions. Our examples include the Moran’s model in population genetics and its variants in community ecology, the Dirichlet-Multinomial Gibbs sampler, a class of generalized...
متن کاملRelative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملRelative Frequencies of Generalized Simulated Annealing
We consider a class of non-homogeneous Markov chains arising in simulated annealing and related stochastic search algorithms. Using only elementary first principles, we analyze the convergence and rate of convergence of the relative frequencies of visits to states in the Markov chain. We describe in detail three examples, including the standard simulated annealing algorithm, to show how our fra...
متن کاملExact Rates of Convergence for Some Simple Non-Reversible Markov Chains
We describe the behavior of certain families of Markov chains as they approach their stationary distributions. Prior methods do not work well for these chains, which are non-reversible, have non-uniform stationary distributions, have little symmetry, and are nearly periodic. Only a few families have been analyzed as precisely as we achieve for these chains, which can now serve as test cases for...
متن کاملRates of Convergence of Some Multivariate Markov Chains with Polynomial Eigenfunctions by Kshitij Khare
We provide a sharp nonasymptotic analysis of the rates of convergence for some standard multivariate Markov chains using spectral techniques. All chains under consideration have multivariate orthogonal polynomial as eigenfunctions. Our examples include the Moran model in population genetics and its variants in community ecology, the Dirichlet-multinomial Gibbs sampler, a class of generalized Be...
متن کامل